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Abstract 



While the Gibbs states of spin glass models have been noted to have an er- 
ratic dependence on temperature, one may expect the mean over the disorder to 
produce a continuously varying "quenched state" . The assumption of such conti- 
nuity in temperature implies that in the infinite volume limit the state is stable 
under a class of deformations of the Gibbs measure. The condition is satisfied by 
the Parisi Ansatz, along with an even broader stationarity property. The stabil- 
ity conditions have equivalent expressions as marginal additivity of the quenched 
free energy. Implications of the continuity assumption include constraints on the 
overlap distribution, which are expressed as the vanishing of the expectation value 
for an infinite collection of multi-overlap polynomials. The polynomials can be 
computed with the aid of a rea/-replica calculation in which the number of replicas 
is taken to zero. 

Key words: Mean field, spin glass, quenched state, overlap distribution, replicas. 
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1. Introduction 



We consider here the quenched state of the Sherrington-Kirkpatrick (SK) spin glass 
model, and discuss some stationarity properties which seem to emerge in the infinite 
volume limit. 

The SK spin glass model [Q has spin variables crj = ±1, i — 1, . . . , N, interacting 
via the Hamiltonian ^ 

H N (a,J) = — -= J i,3°i°i > (!•!) 

ViV l<i<j<N 

with Jjj independent normal Gaussian variables. 

Sampling repeatedly spin configurations a® from the space Sn = {— 1, 1}^, dis- 
tributed independently relative to a common Gibbs state, one obtains a random matrix 
of overlaps q^ m = q a (i) a ( m ) , with the overlap defined for pairs of spin configurations a 
and a' as: 

i 

The quenched free energy, at a given temperature T = is determined in this 

model by the joint distribution of such overlaps for arbitrary number of "replicas" (copies 
of the spin system subject to the same random interaction). 

The purported solution of the model via the Parisi ansatz has a number of 
remarkable stability properties. Our purpose is to discuss some of these, starting from 
elementary continuity assumptions without assuming the validity of the proposed solu- 
tion. Some results in a similar direction were previously obtained by F. Guerra 0. 

Following are the main observations presented here. 

1) We identify a stability condition, in the sense of invariance of the quenched state 
in the thermodynamic limit under a broad class of deformations, which is satisfied 
by the state corresponding to the Parisi solution. 

2) We show that a restricted version of the stability condition is a consequence of a 
property which make good physical sense, namely the continuity of the quenched 
ensemble as function of the temperature. 

3) The restricted stability of the quenched state implies the vanishing of expectation 
values for a family of overlap multireplica polynomials. This accounts for some of 
the relations, though far from all, found in the Parisi solution. 

4) We ask whether the stability condition singles the Parisi family of states (the 
GREM models in the terminology of ||). A considerably simplified version of 
such a question (concerning the characterization of the the REM states) has a 
positive answer || (in preparation). 
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2. Invariance of the Parisi solution. 



Let us introduce the notation employed here for the quenched state, and state a 
remarkable invariance property of the Parisi solution. 



2. a Notation for Quenched Ensembles 

In disordered spin systems we encounter two distinct random structures: the spins, 
distributed (in equilibrium) according to the Gibbs distribution, and the random cou- 
plings (and/or random fields and other parameters) which affect the Gibbs state, making 
it into a random measure. We denote here by < — >, and in case of possible confusion 
by < — >j, the expectation value over the spins averaged with respect to the Gibbs 
state. An average over the couplings is denoted by Av(-). The combined quenched 
average is a double average, denoted below by E(-), over the spins and the disorder 
(whose probability distribution is not affected [in the quenched case] by the response of 
the spin system to the random Hamiltonian). 

Quantities of interest include: 

E {N) fe) = ± £ Av N ( < > 2 j ) = Av N (< a,a 2 >] ) + 0(1) , 

i,3 

and \fNAv N (< a x a 2 > J 2 ,3 < oWi >) • (2.1) 



(where the indices on qi :2 have different meaning than those on a\a 2 ). The second 
example is seen among other terms in -§^E^ (<Zi )2 )- m expressions like this the factors 
Jjj can be integrated out, e.g., through the integration by part formula (for normal 
Gaussian variables) 

Av(Jf(J)) = Av(Jjf(J)^ . (2.2) 

The expression can then be further reduced to an average of a suitable overlap monomial. 

Overlap monomials are functions of the form Yli<i, m <K Qa(i7 a ( m ) defined over the 
product space S® K , S being the spin configuration space. Their expectation values over 
the corresponding product measure on identical copies YIkkk < — >n,j are denoted 
by the symbol 

« n $u>»",j. ( 2 - 3 ) 

l<i,j<K 

and the full "quenched average" is denoted by £'(—), e.g.: 

e (n \ n cr)=^v«< n ?x^)»^)- (2.4) 

l<l,rn<K l<i,j<K 
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We shall often omit the explicit reference to J, to other subscripts such as temperature, 
as well as to N. However, it should hopefully be clear from the context when do we 
refer to a finite system and when to the infinite volume limit. 

Naturally, we are interested in the limit N — > oo. There is no reason to expect (at 
low temperatures) convergence of the state <C — at given realization of the random 
couplings {Jij}- However it does not seem unreasonable to expect convergence of the 
quenched averages of <C f(a) where /(*) can be any local function of the spins. We 
note that elementary compactness arguments imply that for any temperature there is a 
sequence which increases to oo, for which the following limits exists simultaneously 
for all the overlap monomials 

lim n n cr), (2.5) 

l<l,m<K l<l,m<K 

Our discussion will concern relations among the monomial averages which would be valid 
in such limits, under a number of assumptions (which include the existence of the limit). 

Remark: It is possible to develop a more complete setup for the formulation of the 
infinite volume limit of states of the SK model, in which the limit of the quenched 
averages is described in terms of a probability measure on Ai (S) - the space of probability 
measures on S = { — which is the space of configurations of an infinite spin 
system (IV being the set of natural numbers). The elements of M.(S) are random states 
incorporating the effects of quenched disorder. We shall, however, not pursue this line 
here. 

We shall invoke an additional element of structure: Gaussian fields h(a),K(a) 
defined over Sn with the covariances 

Av (h(a^)h(a^)) = %m (2.6) 

Av(K(aU)K(aW)) = ^ m (2.7) 

Av (h(a^)K(a^)) = 0. (2.8) 

which are independent of each other and of J, in the sense exemplified by the relation 

^W^E^M^)) = ^ N \e^^ XnXmqn ' m ) . (2.9) 

(Analogous relation - with replaced by qfj, is assumed for K.) 

In the SK model (N < oo), a quantity like h(a) appears as the cavity field asso- 
ciated with an increase in N, and K(a) can be found as representing the change in the 
action corresponding to an increase in the temperature. The two can be realized as: 

1 N 

%) = -T^E-fo. ( 2 - 10 ) 
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and 

K (°) = ^E<^;> ( 2 - n ) 

i<j 

where the J[ and J"- are normal Gaussian variables, independent form each other and 
from the couplings J appearing in the Hamiltonian. Based on this example, we incorpo- 
rate the averages over the fields h,K under the symbol Av(— ), even when the average 
is at fixed a. 

2.b Invariance of the Parisi solution 

The Parisi solution has the property that quenched averages are not affected by the 
addition to the action of terms of the form F(K(o~), h(o~)), where F(-, •) is any smooth 
bounded function. 

To express the above stated property, let us consider the deformed states 

< -exp{F{K,h)} > N 
<->N,F(K, h) :- <exp{F{Kih)})>N > 

<-»tf,W0 = ®l < ~ >N,F{K,h) > ( 2 - 12 ) 

and 

E F N (kh)H = M< - ^>N,F(K, h )) , (2.13) 

and let E F ( K>h )(—) represent the corresponding limit, as iV — >• oo, for the expectation 
values of overlap monomials (assuming the limit exists). 

Claim 2.1 Assuming the validity of the Parisi solution, in the infinite volume limit at 
any temperature: 

ef { k,h){ n & = e ( n % i m m ) (2.i4) 

l<l,m<K \<l,m<K 

where the expectation value junctionals are to be interpreted as the N — > oo limits of 
expectations of overlap monomials. 

We shall not verify this statement here - the reader is invited to do so from the 
solution which is discussed in || , references therein, and in Q - instead we shall discuss 
the origin and consequences of a somewhat restricted invariance of this kind. 



3. Continuity in the temperature and stability under deforma- 
tion 
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The broad stability of the quenched state expressed by eq. ( |2.14| ) has not yet been 
rigorously derived for the SK model. We shall now find that a somewhat restricted 
version of this condition follows from a natural continuity assumption. 



There is a significant difference between the spin-glass and the ferromagnetic spin 
models in the effect of a change in the temperature on the equilibrium state. Reduction 
in the temperature amounts to increased coercion towards the low energy states of the 
system. If the ground state is unique, it is natural to expect the equilibrium state to 
vary continuously at low temperatures. When there are only few ground states, one 
may expect some discontinuities (as in the Pirogov-Sinai theory ||). However, when 
there is a high multiplicity of competing low energy states the result may be quite 
different. Indeed it is reported that for a given realization of the random Hamiltonian, 
the equilibrium state has a very erratic dependence on the temperature. Nevertheless 
it may seem reasonable to expect that with the average over the disorder, the quenched 
state might vary continuously with /3. 

To illuminate the consequences of the continuity assumption, let us note that due 
to the addition law for independent Gaussian variables, the Gibbs factor determining 
the equilibrium state at the inverse-temperature f3 + Aj3 can be presented as a sum of 
two independent terms: 

{(3 + A(3)H(a, J) = (3H(a, J) + S((3)H(a, 3) , (3.1) 

where A = B means that A and B have equal probability distributions, {J, J} are two 
independent sets of couplings, and 

5((3) = v /2/5A/3+(A/3)2 (3.2) 

With the action cast in the form eq. ( |3.1| ), the modified state is seen to incorporate the 
effects of a strong term (of the order of the volume) pulling in some randomly chosen 
directions, when the main term itself has many competing states. The assumption of 
the continuity of the quenched state appears now as less obvious, and it should therefore 
carry some notable consequences. 

A related observation can be made by considering the effects of deformation of the 
state through the addition of a Gaussian field of the type K(a) (eq. (^)). An easy 
computation based on the fact that 

H(a, J) = VNK{a) (3.3) 

shows that 

^/P + £h((t, J) £ (3H(a, J) + XK(a) , (3.4) 
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i.e. the deformation with a field K is equivalent in a change of the order 0(jt) in the 
temperature: 



M^aicr) = £ (A ^ 2+#) ai<r) , (3-5) 

where the superscripts refer to the size and the inverse-temperature, the subscript indi- 
cates a deformation of the state in the sense of eq. ( |2.12| ) and, as for the eq. (|2.14|) the 



equality is understood when the two measures are restricted to the quantities indepen- 
dent from the deformation variable K. 

In the limit N — > oo, the change in the temperature on the right side vanishes. 
This immediately leads to the following observation. 

Proposition 3.1 If in a certain temperature range the quenched averages E^ N ^{J[q^- 3 ) 
are uniformly continuous in (3, as N — > oo ; and the infinite-volume limit exist for the 
quenched state, in the sense of eq. (\2.3j ), then the limit E^{J[q^- 3 ) is stable under 



deformations by e XK , i.e. 

i- h (\W:r) = 42 (IK?)- ( 3 - 6 ) 

for all the overlap monomials. 

Let us note that the assumptions made above imply also another stationarity 
principle: the quenched state would be invariant under the deformation induced by 
In 2 cosh /3h. To see that, compare the state of iV + 1 particles with that of N. The trace 
over the "last" spin yields for expectation values of functions of the "first" iV spins 

* (w, (n<?) = CfUOte') . (3.7) 



where (3 = y j^r[f3 and h(a) is a Gaussian field with covariance q a ^>. Under the stated 
assumptions, in the thermodynamical limit the previous relation becomes: 



(IK/) = <Lh^(n€-'1 • ^ 



4. A logarithmic relation expressing the stability property 

The stability condition which follows from the above discussed continuity assump- 
tion is indeed found among the properties of the Parisi solution, along with the more 
sweeping stability under deformations of the more general form, as seen in eq. ( |2.14j ). 
This invariance property can also be cast in the form of a "logarithmic relation" , which 
expresses an additivity property for the marginal increments in the quenched free energy. 
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Definition 4.1 We say that a random system, in the quenched state Avjy (<C — ^n), 
has marginally- additive free energy if for any finite collection of independent Gaussian 
fields R( 2 \ . . . , with the covariance eq. \2. and any smooth polynomially 
bounded functions Fi, F2, . . . , F\, the following limits exist and satisfy 

1 1 
lim Av N \n < exp(Y Fi(K (i) )) > N = lim VAwln< expFi(K®) > N , (4.1) 

i=\ i=l 

where the indices label independent families of fields (not to be confused with replica 
indices). 

Our main observation is that the above marginal additivity of the quenched free 
energy is equivalent to the stability of the quenched state (in the infinite volume limit) 
expressed by 

*(iKr) =V)(nc j ) . ( 4 - 2 ) 

where F is an arbitrary smooth bounded function. 

Let us note that the expectation values of quantities involving any of the above, 
can be evaluated by first integrating over the extraneous Gaussian variables (K). Us- 
ing Wick's formula, this integration produces expressions involving the overlaps among 
arbitrary number of replicas, as in: 

E {N) (Kx K 2 K' 2 K' 3 ) = Av N (< K > N < KK' > N < K' > N ) 

= E^( q l 2 ql 3 ), (4.3) 

where we defined K; t = K(o~( l >). 

Conversely, the averages of polynomials in replica overlaps, as q\ 2 q\ 3 in the above 
expression, can be easily expressed through the expectation values of suitable products 
of independent copies of the K field. 

Clearly the stability implies the marginal additivity property (of the free energy). 
To prove the converse, we need to show that (assuming the two limits exist) 



lim Avn 

N^oo 



< G(K) > n , f{ k>)\ = to^AvN [< G(K) > N ] n , (4.4) 



for any integer n and polynomial function G. (The full statement takes a bit more 
general form - involving products with different functions G for the different copies of 
the spin system, however by the polarization argument there is no loss of generality in 
taking the same function G for all the n replicas.) Let us note also that, by an elementary 
approximation argument, it suffices to prove eq. ([4.4|) for bounded functions G. 



The logarithmic property ( |4.1|) implies that for all e 

<p N (e) = Av N \n — — — -> 0. (4.5) 

< exp(eG) > N < exp(F) > N N ^°° 
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For bounded G the function fN{£) is analytical in a strip containing the real axis uni- 
formly in N, and the logarithmic property eq. Qi.lD is equivalent to the vanishing of all 
the quantities (p^\e)\ e= o in the infinite volume limit. By an inductive argument, these 
conditions imply eq. (fOl): first we observe that 



^(e)| = Av N (< G > N , F ) - Av N (< G > N ) -> 0, (4.6) 

which is the stability for the first power (one replica). The second derivative gives 

(p%(e)\ = Av N (< G >% F )-Av N (< G 2 > NjF )-Av N (< G >%)+Av N (< G 2 > N ) -> . 

(4.7) 

Thus 

lim Av N (< G > 2 NF ) - Av N (< G >%) = lim Av N (< G 2 >n,f) - Av N (< G 2 > N ) 

= 0, (4.8) 



where the last equality is by the first order equation, eq. (|4.6|) , applied to the smooth 
function G 2 . Continuing in this fashion one may see that if stability is fulfilled up to 
power n it is fulfilled for power n + 1. 

Remark 4.2 The truncated expectations (cumulants) of order p are generally defined 
by 

QP 

< -;p > T = — In < exp(A-) > | A=0 . (4.9) 
In these terms the logarithmic relation is equivalent to: 

i i 
lim Av N < ^FtiK^p > T N = lim Av N J2 < F, t (K^);p> T N (4.10) 

i=l i=l 



for every integer p. (The implication eq. ( \4-l\ ) eq. (\4-H\ ) is obvious. In the other 



direction the proof can be based on the analyticity argument indicated above.) It might 
be noted that an equation like eq. Hj-lUj ) cannot possibly hold without the average Av ; 
unless the Gibbs state is typically supported on a narrow collection of configurations over 
which the overlap function takes only the value q aa i = 1 . 



Equations ( P~l| ) and ( [4.10| ) have natural counterparts for the more limited stability 
of the quenched state, expressed by eq. (|3.6| ). In that case Fi(K^) need by replaced by 
XiK®, for i = 2, 3, . . . (thought Fx may still be left arbitrary.) 

It is an interesting open question whether there are states stable in the limited 
sense which do not fulfill the stronger stability condition. 
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5. Overlap polynomials with zero average 



We now turn to some of the implications of the stability condition eq. ( |3.6|) which 
was shown to follow from the continuity assumption. Since the free energy and its 
derivatives are determined through the distribution of the overlaps, it is natural to ask 
what consequences does the stability property have in those terms. As we shall see 
next, the implications include a family of relations expressed as the vanishing of the 
expectation value of an infinite collection of overlap polynomials. From a combinatorial 
point of view, expressions with vanishing expectation are constructed by applying a 
certain operation to graphs representing overlap polynomials. 



We shall use the notation encountered already in eq. (|4.3ft , where gi j2 indicates the 
overlap between two spin configurations sampled from two different copies of the system, 
one in replica 1 and the other in the replica 2, subject to the same random interaction. 
Products of such terms can be represented by labeled graphs, introduced below. The 
expectation value does not depend on the particular labeling of the different replicas, 
for instance 

£(9l, 2 92,39l 2 4) = #(51,292,393,4) > ( 5 - X ) 

where we omit, as in the rest of this section, the finite volume symbol N, unless otherwise 
specified. 

Let now illustrate some consequences of the stability condition starting from the 
simple monomial 

Av(< K >\ K> ) . (5.2) 

Stability implies the vanishing of all the derivatives of this function of A. Let us proceede 
for a moment under the assumption, which is proven in the appendix, that the limit of 
the derivatives in A equals the derivative of the limit, which under the stability condition 
is zero. The first derivative gives 

2Av N (< K > XK , (< KK' > XK , -<K > XK ,< K' > XK ,)) (5.3) 

which, at A = 0, vanishes for the trivial reason of parity, at A = 0. On the other hand, 
the second derivative yields 

2Av N {< KK' >\ K , -4<K > XK ,< K' > XK ,< KK' > XK , +3 < K >\ K ,< K' >\ K , 

+ < K > XK ,< KK' 2 > XK , — < K > 2 XK ,< K' 2 >aa-')-(5.4) 

At A = the last two terms cancel and the expression reduces to: 

2E^ N \ql 2 - 8^ 2 g 2 2 3 + 6^ 2 g 3 2 4 ) . (5.5) 



If the quenched state is stable in the sense of eq. ( |3.5|) the above expression tends 
to zero in the thermodynamic limit. 
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As was mentioned already, the stability property is satisfied by the Parisi solution, 
and hence this relation, as well as those of higher order derived below, are satisfied there. 
The particular case of vanishing of eq. ( |5.5|) was recently derived (for almost every beta) 
without any assumptions in ref. (||). One may also note that the vanishing of eq. (|5.5| ) 



is also the lowest non-trivial identity of those listed in eq. ( |4.10| ) (corresponding to p = 4, 
F(K) = K). 

Let us present now a systematic approach for the derivation of other such relations. 

One may use a graphical representation in which a monomial of the form qf 2 Q2,3 
is identified with a graph whose vertices are the replica indices {1,2,3} and the edges 
correspond to the overlaps, qij. Such a graph will be indicated by the symbol (1, 2) 2 (2, 3). 
Furthermore, we shall consider also products involving an additional Gaussian field (K). 
The graphical representation of that factor is a half-edge, represented by a singleton. 
I.e., (1,2)(2) and (1,2)(3) correspond to q\^i and qi^K^. 

We shall use a product "•" which acts in the space of graphs as composition com- 
bined with contraction, where possible, of the two unpaired legs. The notion may be 
clarified by the following examples: 

(1,2)-(1,2)(2) = (1,2) 2 (2) 
(l,2)(3)-(4) = (1,2)(3,4) (5.6) 

(5.7) 

Terms of the form (1, 1) can be omitted, since in our case qii = 1. 

The above product turns out to be commutative but not associative. The order 
of a graph is defined as 2 x number of edges, with half-edges counting as 1/2. Let Wk 
denote the space of formal linear combination of graphs of order k. For G G Wk we 
denote by Qc the corresponding element of the overlap algebra. 

We define 5 : Wk — > Wk+i as the linear operator which acts on single graphs by 

SG= S vG, (5.8) 

vev(G) 

where V(G) is the set of vertices of G, and 

5 v G = G-(v)-G-{v), (5.9) 

where v is a new vertex not belonging to G. E.g., ^(1,2) = (1, 2) (1) — (1,2)(3), 
*x(l,2)(l) = (1,2)(1) • (1) - (1,2)(1) • (3) = (1,2) - (1,2X1,3). 

Following is the pertinent observation. 



12 



Proposition 5.1 For any measure of the type E^ N '(—) = Avn(^ — 3>at) and a defor- 
mation defined in ( \3.(\) 

(>2 E{ N K \Q G )\ X=0 = E^ N \Q 52G ), (5.10) 



dX 2 

for all the elements Q G of the overlap algebra and every N . 



The proof of Proposition 5.1 is straightforward. The operation 5 is the graphical 
counterpart of the usual derivative with respect to the parameter A in the Boltzmann 
weight (where it appears in XK). Such a derivative produces a truncated correlation 
expressed in the rule (|5.9| ). The (|5.8|) is nothing but the Leibnitz rule for derivative of 
products. The first differentiation produces a sum of monomials, each containing an 
unpaired centered Gaussian variable (K) of zero mean. The second derivative produces 
another unpaired variable, which is contracted with the previous one via the Wick rule. 
(This contraction motivates the product introduced above.) 



Proposition 5.2 // in a certain temperature range the quenched averages E^ N,I3 \Q) 
are uniformly continuous in (3, as N — > oo ; and the infinite-volume limit exist for the 
quenched state, in the sense of eq. ( WUi) , then 

E(Q S 2 G ) = (5.11) 

for every element of the overlap algebra. 



The uniform continuity in (3 implies the stability for deformation eq. ( |3.6|) which 
means, in particular, that the limit is a constant in A. To prove the theorem we have to 
show that we can interchange the thermodynamical limit with the repeated differentia- 
tion w.r.t. A, in eq. (|5.10| ). This is shown to be true in the appendix, through uniform 



(in N) bounds on the k-th derivatives of expectations of overlap monomials. 

Following is a related statement which yields a somewhat stronger conclusion (sug- 
gesting a numerical test), which is derived under a stronger assumption. 



Proposition 5.3 In the SK model, at finite values N , 

-^ e(N) (Qg) = N^Ef K \Q G )\ x=0 = NEW(Q S2G ), (5.12) 

for every element of the overlap algebra and every N. In particular if in a certain range 
of (3 the quantities -^E^ N "> (Q G ) are uniformly bounded in N, and the thermodynamic 
limit exist in the sense of eq. ( $.3j ), then for all the elements Q G of the overlap algebra: 

E(Qs*g) = 0(l/N) . (5.13) 
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The proof of the first equality can be obtained computing the second derivative 
with respect to A of equation eq. Q3.5|) at A = 0. The second equality is eq. (|5.10| ). 

Analogous statements hold for other mean field spin glass models, with the p-spin 
interaction Hamiltonian ([[/J) 

H(a, J) = - Yl J iu-,i P a h ■■■ a ip> ( 5 - 14 ) 

l<ii<--<i p <N 

where Ji lt ... t i are Gaussian variables, rescaled so that the Hamiltonian covariance is 

AvH(a, J)H(cr', J) = N(f C!jl . (5.15) 

(Under the above calling, H reaches values of order N. The corresponding choice for 
the field K is Gaussian with the covariance Av (K(a)K(a')) = q v au i- The definition of 5 
is unchanged. 



6. Computation with real replicas 

In this section we give several characterizations of the overlap polynomials of the 
form Qpq f° r which we prove that under certain conditions they have zero mean. 

The main result is a formula which permits to compute the polynomials from a 
quadratic expression in the number r of rea/-replicas, evaluated at r = 0. To state it, let 
M r = J2i^j=iQi,j, f° r all integers r > 1. Let E(— ) be an expectation value functional, 
on the algebra of overlaps, which depends only on the graph structure of the overlap 
monomials (i.e., is independent of the choice of labels). Then the quantity E(QcM r ) is 
quadratic in r. In the following proposition, we refer to the polynomial extension of this 
function to all real r. 

Proposition 6.1 For any expectation value functional E(-), as above, 

E(Q 5 2 G ) = E(Q G M r )\ r=0 . (6.1) 

where the quantity E(QgM t ) is first computed for r large enough so that all the indices 
appearing in Qg do appear also in M r and r > \G\ + 1. 

To illustrate the statement, let us take: G = qf 2 - in this case, the left side of 
eq. ( |6.1|) is given by eq. ( |5.5| ) and the right side is: 

E{ql 2 M r ) = 2E(ql 2 ) + 4(r - 2)£( gi 2 2 g 2 2 3 ) + (r - 2)(r - 3)£(g 2 2 g 3 2 4 ) . (6.2) 

The two coincide at r = (defined by polynomial extension). 

The proof proceeds through the explicit computation of the left and right sides of 
eq. (fTO). 
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Lemma 6.2 If the number of vertices in G is I then 

5 2 G=Y J G- (v, v')-2lY,G- (v, v) + l{l + 1)G • («, « ')> ( 6 - 3 ) 

where v and v' are summed over the set of vertices of G and v and v' denote a pair of 
added vertices. 



This is a rather explicit expression for the polynomials corresponding to a given graph 
G. Two examples are: 

5 2 (1,2)(3,4) = 4(1,2) 2 (3,4) + 8(1, 2)(2, 3)(3,4) - 

-32(1,2)(2,3)(4,5) + 20(1, 2)(3, 4)(5, 6) , (6.4) 

and 

5 2 (1,2)(2,3) = 4(1,2) 2 (2,3) + 2(1,2)(2,3)(3,1) - 12(1, 2)(2, 3)(3, 4) + 

+12(1,2)(2,3)(4,5) - 6(1,2)(2,3)(2,4). (6.5) 

Remark In the above example 5 2 G is a polynomial expression with integer coefficients 
whose sum is zero. That property is shared by S 2 G of arbitrary monomials G. 

To prove the lemma we note that by the definition of 5 

6G = Y,G-(v)-lG-{v) . (6.6) 

V 

Applying this rule twice 

S 2 G = J2 G ■ ( v > v> ) ~ l J2 G ■ ( v >v) ~ lJ2 G ■ <V> v) -lY,G ■ (v,v) (6.7) 

v,v f v v' v' 

+l(l + l)G-(v,v'), 
which coincides with eq. ( |6.3j ) since (v,v) = 1 for every v. 

Lemma 6.3 If all the replica indices appearing in Qg are contained in the entries of 
the matrix M r and r > I + 1 then 

E(Q G M r ) = Yl E{Q G . {v>vf) ) + 2{r-l) ]T E(Q G . M ) 

v,v'eV(G) v ^ v ^ 

v 7^ v' 

+ (r-l)(r-l-l)E(Q G<m ). (6.8) 
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This formula is an elementary consequence of the fact that the measure E(-) de- 
pends only on the isomorphism type of the graph associated to a given overlap monomial. 
The first sum on the right side of eq. ( |6.8| ) corresponds to those overlap terms in M r 
which involve only the replicas appearing in G, the other two sums are split according 
to whether the number of vertices not in G is 1 or 2. 



The two previous lemmas prove Proposition 5.1 



7. Comments 

We have seen that elementary continuity assumptions on the quenched state, imply 
a stability property for the infinite volume limit of the SK (and other mean-field) spin- 
glass models. A particular implication is the vanishing of the expectation values of 
certain multi-overlap polynomials, which form an infinite dimensional family. We also 
saw a related condition expressed through an explicit decay rate for the expectation 
values of suitable quantities. 

These observations are consistent with the Parisi theory. However, the family of 
identities discussed here does not yet permit the reconstruction of the joint probability 
distribution from that of a single overlap, as is the case under the Parisi Ansatz. 

It has been pointed out that within the replica-symmetry- breaking approach the 
vanishing of the expectation values of the polynomials discussed here (5 2 G) requires only 
the so called "replica-equivalence" assumption, which says that in the matrix Q (defined 
in H) each row is a permutation of any other. We thank I. Kondor and M. Mezard for 
calling our attention to this point. See || for a recent account on replica-equivalence. 

An interesting question is whether the stability property is the stationarity condi- 
tion for some variational principle. This is related to the main question which emerges 
at this point, which is whether stability implies the GREM state structure Q. We study 
a restricted version of this question in a separate paper ||. 



A. Appendix 



In this appendix we show that the limit N — > oo can be interchanged with the 
differentiation, in formula (|5.10| ). This is seen in two steps. The first is a general 
criterion. 



Theorem 1.1 Let F n (X) be a sequence of functions defined over the interval A G [—1, 1], 
which: 
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a) converge pointwise: 

b) have uniformly bounded derivatives up to order m+1, i.e. satisfy 

l^n(A)| < Const. (A.2) 

for all X G [—1, 1] and k — 1, . . . ,m + 1. 

T/ien /or k = 1, . . . ,m the derivatives also converge (pointwise and uniformly), the 
limit is differentiable, and 

^G(A) (A.3) 

We omit the proof of this basic criterion. (For m — 1 it can be proven by using uniform 
approximations for ^F n (A) in terms of the differences [F n (X + e) — F n (X)]/e, and the 
rest is by induction.) 

The stability stated in Proposition 3.1 amounts to an (a) type condition for F n (X) = 
E { X N K \Q) where Q is any overlap monomial. The limit is a constant function. The 
above principle will allow us to conclude that under the assumption of Proposition (3.1) 
E(Qs^g) — 0, as soon as we show that the derivatives are uniformly bounded (i.e., 
establish condition (b)). Following is a detailed version of that statement. 



Proposition 1.2 Let Q be an overlap monomial which involves r replicas. Then, for 
any N < oo ; 

' k : E{ N K \Q)\ < 2r k+1 k\ (fc + l) fe+ V 1+A ) 2+A2 . (A.4) 



d k 



f dX k 

Proof: The expectation value of Q are expressed as E^(Q) = Ai>n "C Q ^>n,xk 
with a finite product <C — ^xk= ®i=i,...,r < — >\k ■ Using standard formula for 
the derivative, standard bounds on the truncated correlations (see for instance Theorem 
II.12.6 in U), and the fact that \Q\ < 1 



— k E{ N K \Q)\ = \Av N \^Q-j^K{a i )-----j^K{a i ) > >iW 



dX \ i=i i=i 

k 

k+1 



< (k+ lf +i Av N <C 



i=l 



< (k + 1) + r + Av N {< \K\* > N;XK 
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Since K can be arbitrarily large, we face here a minor version of the "large field problem" . 
However, it can be resolved by the following estimate, 



—Av N (< \K\ k > NtXK ) < 



< 2Av N (< e K >nxk) = 2Av 



<e^ K > N 



< e XK > N J 

'- '" - / r n-2\V2 



< 2 (Av N [< e^ K >%} 2 ) x (Av N [< e XK > N ] ~ 2 ) 



For the first factor, an elementary calculation gives the bound e( 1+A )\ For the second 
factor we get 



Av 



N 



-2 



< Av N (exp [-2 A < K > N }) < e 2>? (A.5) 



where we used first the Jensen inequality and then the fact that < K > is a gaussian 
variable of covariance < 1. ■ 
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